1
From Unconditional to Conditional: The Power of Information
MATH005 Lesson 3
00:00

Probabilistic reasoning is not a static calculation; it is a dynamic process of updating beliefs. In an unconditional setting, we assume a state of general ignorance where all outcomes in the sample space $S$ are possible. However, information is a mathematical filter that discards outcomes inconsistent with observed reality.

When we say event $F$ has occurred, we move from the global space $S$ to a restricted universe $F$. The conditional probability of $E$ given $F$, denoted as $P(E|F)$, is simply the proportion of the new space $F$ where $E$ also happens.

The Narrative of Evidence

The transition from $P(E)$ to $P(E|F)$ is the mathematical foundation of evidence-based estimation. If $P(E|F) > P(E)$, the evidence $F$ is supportive of hypothesis $E$. If $P(E|F) < P(E)$, $F$ contradicts $E$.

The Meal Choice Reduction

Imagine a catered event with the following fixed menu options:

CourseOptions
EntreeChicken, Roast Beef (2)
StarchPasta, Rice, Potatoes (3)
DessertIce cream, Jello, Apple pie, Peach (4)

Unconditional Space: There are $2 \times 3 \times 4 = 24$ total possible meal combinations. $P(\text{Pasta}) = 8/24 = 1/3$.

Conditional Information: We learn the guest is a vegetarian who definitely chose the "Pasta." Our "Starch" choice is now fixed ($1$ option). The denominator of our universe collapses from $24$ to $2 \times 1 \times 4 = 8$. This is the power of information: it shrinks the sample space and shifts the denominator.

Defining the Formula

For any two events $E$ and $F$, if $P(F) > 0$, the conditional probability is defined as:

$$P(E|F) = \frac{P(EF)}{P(F)}$$

🎯 Core Principle
Conditional probability represents a recalculation of likelihood. Information reduces uncertainty by eliminating the portion of the sample space that did not occur, forcing us to re-evaluate the remaining events relative to the new, smaller universe $F$.